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Sigaal processing 



FIELD OP THE INVENfTION 

Tbe present mventioa telates to porocessing of infonnation signals and, more 
pardcularly to processing of audio signals. 



5 



BACKGROUND OF TEffi INVENTION 

The mtrodnction of new systems like DVB and DVD has ttrougbt digital 



mtdti-'Gliaxmelsoinid within gcoup of users. Thcmsgori^ of users will 

however stay for a long time vnOx stereo sound reproduction. 



One solution to bolh serve consumers ^th 2-«haxmel equipmmt and nuilti- 



10 cbannel equipmentis so*caUed simulcast In this case, two separate infoimation sdgaals are 
transmitted in parallel, one oootainiog axepieseiitation of the multir«channfil sound and one 
cxinteining aifepcesentation of ^2<-chaDndl sound. To achieve an economical use of 
tcansmission w storage capacity* audio bit rate reduction will he used in most applications. 
The transmitted or stored information signal will then be in ihe form of a coded Ut stream, 

15 vvbish reqmres a decoder to retrieve the audio signal to be reproduced. Keveriixelesai it is 
obvious that sinudcast is an expensive solution in tenns of required transmission or storage 
c&gSLCity, This makes Ibis solution unacceptable in most practical situations. 



directly serving iho consumers with multi-diannel sound xepioduction equipment. The 2- 
20 chamiel user? then need a decoder Hist con^sts of a multi-chanuel decoder, followed by a 
dowmnix module that creates a dowmnix fioxn multi-ohcinnel to 2-cdkanneL Such a 2-channel 
decoder is thus more complex than a tegidar multi»^haanjel decoder. In this casd 1b» 2- 
chanael users (the mcy orlty) have to pay for the muM-channfil capability of others. 



25 capabilities of a system, in the £nm of higher costs or higher power consumption. It is also 
undesirable to waste bandwidlh of the system by simulcast (storage and transmission of both 
a 2-ohannel (stereo) and a molti-chaunel stream). 



be decoded by both a true stereo decoder and a multi-channel decoder is the MPBG-2 audio 



AnoOier solution Is to transmit only the multi-ohannel information signal. 



It is undesirable that those users ate burdened by the multi«dhannel audio 



An encoding system that allows a single coded multi-channel audio stream to 
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l^ckwaids compatible millti-chaimel oodec BC). In all other oodix^ systems, ibe 

stetreo decoder 15 basically a (an exp^sive) muIti-ohaAxifil decoder followed by a dcwn-mix 
tosteiieo. 

The MPB0^2 BC coder achieves fbls by perfonnhsig at the encoder dde a 
5 dowa-xnix from e. g. 5 channel aoiudto steteo, coding thi? a$ apure stereo stream, and 
encoding as an extension three properly chosen signals out of the &ve input signals. The 
staeo decodcHT only decodes the pure stereo stream. A mnlti-channel decoder also decodes 
the extra In&rmations andnses an inverse matiix to tetrieve the origuial 5 channels ftom the 
do^-t»ix and the additional three chfinnels. 

■ 10 - US-Bl-6275 589 describes MPEGw 2 havfaig backwards compatibility with 

3M0PBG-1, wh^by the signals of mnlti-diannel sound channels are matnxea» ii^tereo signals 

ralculated in a process are then transmitted as an MPBO*-! -compatible stereo signal and 
remaining audio signals are transmitted as sispplementaiy data. This method is known as 
^compadbilily matrixingf*. 
15 In "Compatibility Matrixlng of Multi-Channel Bit Rate Reduced Audio 

Sigoals" by tan Kate, preprint 3702, 96*^ AES Coweniion^ 1994, February 26 - March 01, 
Amsterdam, it is recognised tiiat the MPEG-2 BC system is not working in an optimal way in 
case one of the signals in the multi-channel configuration is down-mixed to both the left and 
right chamiel of the stereo dowmnix. This is specifically the case for the Centre channel or 

20 for a monophonic Surround channel. The first situation is commonly r^enred to as the 
'T>ominant Centre" situation. 

SUMMARY OF THE INVENTION 

It io on object of the invention to pro^'ide impro^esd enc^^ing of multiple input 
25 signals employing compatihility matrixing. 

According to an aspect of the invention, this object can be realised by 
orfhogondlising a composition of signals prior to encoding. 

It is another object of the inv^tion to provide dominant centre and/or 
surround signal processing of multi-channel audio signals^ in particular when down-mixing 
30 multiple channels to stereo. 

According to another aspect of the invention, there is provided sum/difference 
signal coding of a compatible signal in case of a dominant centre signal situation or a 
dominant suiround signal situation. 
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According to another aspect of ttie invention, fh^e is provided a 2-^channel 

decoder that is capable of dominant centre and/or $iiztound processing. 

According to a preferred embodiment of the invention, there is provided a 

method fo3P encoding N input signals, with N>2, said method comprising the steps ofl 
5 - generating fiom the N Input signals a composition of M signals, \vith N>M^ 

-* encoding the composition of M signds Into coded data, 

- encoding a selection of N-M out of the N input signals into coded data, 

wherein the composition of M signals is orfhogonalised prior to encoding. 
Preferably5,M=2. 

1 0 Preferably, orthogonallsation is done in the frequency domain. 

Preferably, orthogonalisation is done by switcWng between indepwidflnt 
coding and sum/difference coding, preferably to sum/diflference coding In case of a Hftm^atit 
centre situation. 

Preferably, switching between independent coding and suro/^fBsranoe cod&ig 
15 can be sdeoted per frequency band. 

According to anotfier embodiment of the invention^ there is provided a method 
for decoding two coded bit streams^ the method comprising the steps of ' 

- decodfaig a first coded bit stream into a composition of M signals, 
decoding a second coded bit stream into a set of N-M signals, 

20 - generating a set of N output signals fi?om the composition of M signals and the set of N- 
M signals, 

wherein the composition of M signals is de-orthogonaK 
signals. 

Accotding to another embodiment of the invention, thm is provided an 
25 qyparatus for encoding N input signals, with Ni>2. said apparatus comprising means fen 

- geofiiBting from the K input signals a composition of M signals, with Ni>Ma2, 

- enoodmg the composition of M signals hito coded data, 

H encodmg a selection ofN-M out of the Nmputsigoalsin^ 

- orihogonalising liie composition of M signals prior fo encoding. 

According to another embodhnent of the invention, tiiexe is provided an 
apparatus fee decodmg two coded bit streams, the apparatus con^rising means for 

- decoding a first coded bit stream into a composition of M signals, 

- decodhxg a second coded bit stream into a set of N-M signals. 
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- generathagasc*ofNoutptttdgnaIsftomfeecc«»positoofMsi^ 

M signals, _ ^ * 

- .dew3ra»Dgq«nalisinglheoompo8i11oixof^ 



_1Q_ 



According to another enAodhnent of the invention, there is provided a signal 
format fi» use In Hansniittiiig coded daia of M signals generated from N inpirt signals. ^ 

'iP'JiASS', compelling: 

- acojnposition of M signals, 

. acompodtionofN.Msignal8,vvl,er^saldcompositionof 

These and other aspecia and embodiments of fee invention will be parent 



BRIEF DESCRIPTION OP THE DRAWINGS 

The present invention vrill be mor» clearly imder^ 



15 



in 
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attached drawings, in wHch: 

Fig. 1 mxwttabesattodtdiagwof asysteminv»Wd^ 

Hg. 2 muBtrates a^ignal going out fiom an encoder after dovra-rotodng. 
Fig. 3 illustrates a flow diagram fia a method according to aprefecced 



DETAILED DESCRIPTION OF THE rNVBNTEON 

IttFlg. 1 it is iUnsttated an overall Wodc diagram of a system 10 in Tvfaioh the 
25 presentinvenfionisimplfimentcd.Hie system 10 comprises amatcix Uanencoder2 

including a stereo encoder 2a and a sor^oiwd extendon encoder 2b. a do^-mixing unit 3 , a 
stereo decoder 4, including astereodeco<ter4aanda sunound «ttension decoder 4b, an 
iitverse maiiix 5 andmeans 15 fbr switoWnglte coding ca«ied ^ 
at least two coding modes. The system 10 illnsliatedinPig. X shows amnlti-cbamiel 
aacoder/multi-<tonel decoder systemhavingdovm^ 

The encoder 2 can be provided with meaiB for, 

- geaeratingfiomth0NinpntslgnalBac«npoffltionofMslgnak.vnthN^ 

- encoding the composition ofMagnals into coded data, 
,ding a selecHoii of N-M out of Ih© N input signals into coded data, 



30 



encoG 
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orUiogonalisdng the compositton of M signals prior to encoding. 

N input channels, h^e mxati-^^liantiel audio signal a left channel L, a right 
channel a centre sigi^ C> a loft surround signal LS, and a right sunound signal RS are 
first transmitted to fiio matrix 1 and ftitther to die encoder 2 conaprising the stereo encoder 2a 
5 and a suitound encoder 2b, The encoding perfonned is a so-called **perceptqal audio 

encoding'', whereby earfi of a succession of time doraain blootcs of an audio signal is coded 
in the frequency doxnaln. Specifically, the frequency domain representation of ea<fli block as 
divided into coder bands, each of which is individt^ally coded, based on psycho-acoustic 
criteria, so that the audio signal is compressed efficiently. When the audio signal conoptises 
10 two or more input channels, typically a left L and a right R channel (stereo^ the coding Is 
carried out on a coitesponding number of ''mattixed" channels LO and RO. However, in this 
case five incoming signals are shown. Other types of coding schemes can also be possible, 
but are not fbrther described in this example. 

The encoding can also be performed by softwaie-only solurions. 
15 The encoded signal is down.-mixed (or blended) in the down-mixing unit 3 and 

ti:ansnuttedasasignalQouttothedecoder4asacompM^ signals ma first bit- 

stream and a selection of N-M signals in a second Wt-staream (illustrated as two arrows going 
into the decoder 4). The signal Qout is illustrated hi Fig. 2, which illustrates Hie two bit 
streams ''onto" each other. Each bit-stream conaprisea a header 7 and ^ta fidds 8, 
20 The decoder 4 can comprise means for: 

- decoding a first coded bit stream into a oompositiQn of M signals, 

- decoding a second coded bit stream into a set of N-'MsignalS;, 

- generating a set of N output signals fi?om die composition of M signals and ihe set of 1^- 
M signals. 

25 - -de-or£hogonalising Uie composition of M signals prior to the generation of N oucput 
sigoala. 

Fig. 3 illustrates a flow ^gram of amediod according to apre&ned 
emJ^odiment fi>r encoding N input signals, wi1hN>2. In afirst step 101, N input signals are 
transformed to a fiequency domain prior to encocfing. hi a second step I02» asum/da£K»?en^e 
30 mode is selected m case of a dommant centre situation (indicated Yes) or an indepepdant 
mode incase of no such situation (indicated No). This step is also restoed to as the 
orthogonalisation step. In a third step 103, a composition of M signals is coded into a bit 
stream of data^i typically a first bit-stream and a selection of N-M out of the N input signals is 
coded into anotbear bit-stream of data, tyxncally a second bit-stroam of data. 
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For instance, the or&ogonalisation can be perforaxed par frequency band. 
According to another embodiment of the invention, there is provid€sd a method 
for decoding two coded bit streams, the method comprising the steps of 
_ (jecoding a first coded bit slieam into a composition of M signals, 
5 - decoding a second coded hit stream into a set of N-M signals, 

- geneiating a set of N output signals ftom the composition of M signals and the set of N- 
MslgDflls 

vherdnlhB oon^sition of M iSignals is de-orthogonalised prior to the generation of N output 
signals. This eiribodimeat can also be ilhistratedby the flow diagram illustrated in Fig. 3 and 

10 will iherelbre not be fteflier disclosed herem, since "encoding" can be replaced by 

•♦decodini^. 

Bxamples of matrix e<raationa will be described bdow to explain the inventloft 
better. The matrix equations 1- 21 describe a shnafian vrhei© the present invention is not 
necessary. These equadons axe sihownto describe the saooding and decoding befbre 
15 describing file eqpafions of aptefesoedeaibodimOTt of Aeinv^ 

qndeistandins of the invention. 

Example maliix eqjwtioos are the folloi)tfing (gai^ 



20 



At the encoder side: 



Lo-L + C+LS 0) 

Rd=R+C+RS - <2) 

T4=LS C4) 
25 T5«RS 

VfTaiae the transmisdm channels arei LO , RO, T3» T4 and T5. 
At the decoder side: 

30 C'=T3' C6) 

LS'-T4' (7) 

BS'=.TS' (*) 

L'=Lo'-C'-LS' = Lo'-T3'-T4' (9) 

R'=Ro'-C'-RS'-'Ro'-T3'-T5' (10) 



7 



013 05.04.2002 12:0 
03.04^002 



Vfbs3:o tixe sign ' denotes a decoded signaL 

Although ihs matrix inversion at the decoder side is exac^ the equaticms above 
do not yield eacactly the original input signals, because the transmlasion Qhaimate LO, RO, T3, 
5 T4 and T5 are altered by ihe encoding. The coding of T3, T4 and TS is diiectly controUed by 
the perceptual encoder and by the qualily of C, LS' and RS', vift^ will not give rise to 
pcoblrans. 

In the example presented above, due to the matiijdaa *be coding noise in LO, 
T3 and T4 will appear in L', and the coding noise in Rfl, T3 and T5 will ^jpear in R'. This 
10 coding noise could be nunimised by choosing appropriate ejcfta channels to be transmitted 
with LO and RO. If C, LS and RS are the wealrest signals^ then the coding noise in L' and R' 
will be dominated by LO' and RjO', tespeotrvely, which is again directly coxrtroUed by the 
paceptual encoder. If anoiher signal oombbatioa is the weakest this signal combination 
should be chosen to be tiansmittiBd as T3, T4 axid T5. 

*3towever. when the csiitre signal C is the strongest signal (in the foUowi^ 
referred to as tiie "dOMioant centre" situation), LO la almost ^ 

Has can be r^nesented by tiie Allowing &nmilas: 
At file encoder side: 

20 JLO=L + C + LS 
RO=R+C + RS 
T3=L 
T4 = L 
T5-RS 

25 

At the decoder side: 

L'«T3' 
LS'=T4' 
30 RS'^TS' 

C » LO' - L' - LS' « Lo' - T3' - T4' 
R' - RO' - C -RS' «R0' - C - T5' 
= RO' - LO' + T3' + T4' - T5' 



(11) 
(12) 
(13) 
(14) 
(15) 



06) 
"(17) 
(18) 
(19) 
(20) 
(21) 
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^ R' is small, RO ' - LO ' are both large and T3 ' + T4 ' - T5 ' ar e all smalL 

It can be sho^ that o»e of the smaU signala always needs to be retrieved by 
subtracting two large almost equal signals to obtain a small signal. It Is clear that a relatively 
smaU enor in LO or RO will lead to a relatively large and clearly audible error in the resulting 

5 signal. This qaaliiy could be maintainedj but only by coding at least one of the compatible 
signals T3, T4 ox T5 at anmcb higher bit-rate than is necessary for good sound quality of that 
signal on ftaetf ■ As desoxibed above, another way could be to code additional transmission 
channels, in this case for instance feur, but this is typically a waste of band>vidfh as weU. 

Therefore, according to an aspect of the invention, there is provided an 

10 encoder for sum/difitoeace oodhig of &e compatible signal in case of a dominant centre 
situation. In this way, the centre dgnal C ftUs out of one of the equations for the compatible 
signal, and that equation caabe used to calculate a fourth small signal. Of course, for a non- 
dominant situation, everything can remain the same. For a dominaat 

iiie oonqjatible signal is added: 



At the encoder side: 

LO = L + C + LS 
RD-R+C+RS 
T3=L 
20 T4=LS 
T5«-RS 



(22) 
(23) 
(24) 
(25) 
(2(5) 



ChO-LO+RO-L + R+aC + LS + RS (27) 



25 



Chi =LO-RO='L-R+LS-RS 
At the decoder «ide: 



C28) 



00) 
<31) 



LS'=»T4' 
30 RS'«T5' 

R'«L'+LS' -RS' -Chr =T3' +T4' ^TS' - CJhl' (32) 
2C'-CbO'"L'-R'-LS'-RS'»ChO'+Chl'-2T3'-2T4' (33) 
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Now R' can be obtained from small signals only, C from one strong signal 
(CbO') plus a number of smaU signals. The situation wherein strong signal? are sidytraQted 
ftom eaoh other to obtain a small signal is avoided in this way. Ih the compatible stereo 
decoder A, the following matrisc has to be perfoimed: 

L0'=(Ch0 + Chl)/2 

RX)'='(caio-caii)/2 

If the Bumnmd eictension decoder 4a is omitted, there is provided amulti- 
channel encodei/stereo decoder instead. In this oase« two transmission channels iiroviding a 
stereo stream caiiymatnxedsunound. The matrixS mthe de 
two chamids do not comahi anormal stereo down^ but a matrixed auTO 
signals we then tiansnutted in an additional signaL Using a inat^^ 
decoder 4 makes it possible to letrieve the origfaial 5 channels flom the s^ 
additional three (shanaels . In addition, tiw output of &e stem, dec^ 
tiansmltted to an ii^ut of a rnalrixed surround decoder, 

AiiothersituaticmvAere the invention finds ap^^ . 
flie snriound signals and/or RS is^« ae slwngest flignal(s). this 
called "dominant swxound sohition". hi ihis situation, LO is m amplitude ahnost equal to RO 
but in ami-phase. Selecting the left ohawiel L, Ae right channel R and 
traaamission in the T3 . T4 and TS makes it impossible to i^eve LS and RS with an inverse 
matrix. It can be shown that always one of fte smaU signals needs to be retri^ 

LO ' and RO ^ The weakest of LS and RS should be selected as Ihe thhd additional 
is illushated in an example bdow: 

LO«L + C-LS"RS 

RX)«R + C + LS+RS (37) 

'^^''C (38) 

= ^ (39) 
30 T5=RS ^4^j 



15 



20 



25 



At the decoder side: 



(41) 
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LS-T4' 
RS'=TS' 

LS'= L' - C - LO' - RS' = T4' + T3'- LO'- T5 
R' = RO' - C -LS'- RS' « BO' - T3' - LS'- T5' 



(42) 
(43) 
(44) 
(43) 



DqstoHwfiiCtliuitLO'andRO'areiii anti-phase this means Uaat adding two 
large almost equ^ signals to obtain a small signaL It is dear that a relatively small e«or in 
LO' ot RO' ^ lead tD aidativeay large and clearly audible eiror in the resulting signal. The 
qoality can still be malnlained. but only by coding at least one of the compatible signals y>iiii 
, ^ . ^ip w blt-^ titan necessary for good soimd gualily of that signal on iteel£ Also m 
tMs case could aaoiher w be to code additional ttansmission channels at tiie cost of waste 
ofbandwidtb. 

Accoiding to another piefened embodiment of ti» invention, amatrixingof 
^ compatible signal is added aooording to tije following equations: 
15 At Iho encoder side: 

LO'^L + C-LS-LS 

RO-R+C+LS+RS ^'^'^ 

(48) 



T3-C 
20 T4-=L 
15*= RS 



Ca»0 " LO +R0 = L + R+ 2C 

Cai - LO -RO L -R + 2LS - 2RS 

At the decoder side: 



(49) 
(50) 

(51) 
(52) 



C'=T3' 
L's»T4' 
30 RS'-T5' 

R'= ChO'- L'- 2C' - ChO'- T4'- 2T3' 

2LS' = L' ^ R' - 2RS' - Chi' = T4' - R'- 2T5' ► CShl' 



(53) 
(54) 
(55) 
(56) 
(57) 
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Now R' is oljtalned ftom only small signals, LS' from on© strong signal 
(Chi 0 plus a number of small signals. The situation that strong signals are subtracted fiom 
each other to obtain a small signal ip avoided in this way, Jathe conqiatible steieo detsoder, 
lh& following matrix has to be pexfonned: 

Lo = (ChO + cail)/2 (5gj 
Ro-CChO-Chiya ^5^^ 

The inventioii finds i^pllcadon for instance in CD-2. and ofimr mnlti-channsl 
music distnbudon. 

The coded data can be stored and subsequapjly read, decoded and presented to 
a Ustemer of a record caitier. 

It should be noted that Hxe above-mentioned embodlmeats illustrate zatbec fban 
limit the imrentiOD, and that those skilled ia the art wiU be able to design mai^ alternative 
embodiments without departing from the scope of the appended claims. In the claims, any 
reference signs placed between parentheses shaU not be constmed as Umiting the daim. Hie 
word 'comprising' does not exchide tiie |»esence of other elemoits or ste3>s than tiiose listed 
in a claim. The invention can be inaplemented by means of hardware oomptlsiog several 
distinct elements, and by means of a suitably programmed con^uter. In adevice claim 
enumerating several means, several of these means can be embodied by one and lha same 
item of hardware, the mere feet that certain measures are recited in mutoaUy di^sreot 
dependent claims does not indicate tiiat a combination of these measures cannot be used to 
[e. 
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CLAIMS: 



1 . A me&od for eacoding N inpvt signals, with N>2. said mefboA comprising liie 

steps of: 

- genOTatingfromtheNinputsignalsaconq»osMoiiofMsign^ 

- encoding the compo8iti<m of Maigodte into coded dat^ 

- enoodingaselectionofN-MoiitoflheNinputslgpalsintocodeddata, 

wfaeretoAwrapo^aioD.o£M^en a1fl h OTthogona li' ^ed prior to eacoding. 



2. AiMiiwdaoootdingtodfliml.i'Vhiaetoi^ 

into afirst bit-stream, tmd ihosdecdon of N-Mdgoala is coded into a second Wt-S^ 

3. A niettiod according to daim lor 2, 'Wherein M-2. 

4. A mef&od accord to any one of -flie claims l^, flirther conqwdsJag the stq> 
of; 

- selecting of a si«»/difEbieniooinodeversi»a an indepettdontootf^ 

5. A method according to any <»ie of Iha claims 1-4, -wheiefai ihe N ii«mt signals 
is ttansfoxmed to a ftequancy domain priorto encoding. 

6. A method according to any one of fee dahua 1-5, ydifiieiaihe 
orthogonalisadon is performed per fiequancy band. 

7. A mefliod for decoding t«ro coded bit stimns, the meflxodcon^jriangfliB 

Steps of 

- decoding a first coded bit stream into a composition of M signals, 

- decoding a second coded bit stream into a set of N-M signals, 

. generatingasetofNoulputsigQalafromtbacompositionofMsignalsaodfhes^ 

M signals* 
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wherein the oomposition of M signals is (te-orfliogonalised prior to the generation of N output 
signals, 

8. Apparatus for encoding N input signals, with N>2, said apparatus comprising 
moans for: 

- generating firom the N inpijt signals a composition of M signali^ vrfth N>Mfe2, 

- encoding Ihe composition of M signals into coded data, 

- encoding a selection of N-M out of the N input signals into coded data, 

- ortbogonalising the composition of M signals prior to encoding. 

9. Apparatus for decoding two coded bit streams, the apparatus comprising 
means for 

- decoding a first coded bit stream into a composition of M signals, 

- decoding a second coded bit stream into a set of N-M signals, 

15 - generating a set of N output Signals ftom the composition of M signals and the set of N- 
M signals, 

- de^orfhogonalising the composition of M signals prior to the generation of N ouftrat 
signalSi 

20 10- A signal format for use in transmltdng coded data of M signals generated from 

N input sigaalSp wift N>MS2, Gom|>iising: 

- a composition of M signals, 

- a composition of N-M signals, wherein said con^oaition of M signals is orihogonalised. 



2S 11 . A record carrier on which a signal format as claimed in claim 1 0 has been 

stored. 



PHNL020297E1^ ^ 020 05.04,2002 ^12 

14 05.04.2002 

ABSTRACT; 



Smn/diffescence coding of a compatible signal, typically in c^e of a domtoant 
ceixtre sigiial or dominant OTtroimd situation o£ a multi-channel audio stream to to decoded 
by botibi a stereo decodej: and by a multi-chaxmel decoder, to provide improved encoding of 
multiple input signals employing compatibility matrixing. 
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FIG. 2 
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